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ABSTRACT 

There are several web platforms that people use to inter- 
act and exchange ideas, such as social networks like Face- 
book (2], Twitter [ll], and Google-|- [2]; Q&A sites like 
Quora and Yahoo! Answers; and myriad independent fora. 
However, there is a scarcity of platforms that facilitate dis- 
cussion of complex subjects where people with divergent 
views can easily rationalize their points of view using a 
shared knowledge base, and leverage it towards shared ob- 
jectives, e.g. to arrive at a mutually acceptable compromise. 

In this paper, as a first step, we present Widescope, a novel 
collaborative web platform for catalyzing shared understand- 
ing of the US Federal and State budget debates in order to 
help users reach data-driven consensus about the complex 
issues involved. It aggregates disparate sources of financial 
data from different budgets (i.e. from past, present, and 
proposed) and presents a unified interface using interactive 
visualizations. It leverages distributed collaboration to en- 
courage exploration of ideas and debate. Users can propose 
budgets ab-initio, support existing proposals, compare be- 
tween different budgets, and collaborate with others in real 
time. 

We hypothesize that such a platform can be useful in bring- 
ing people's thoughts and opinions closer. Toward this, 
we present preliminary evidence from a simple pilot experi- 
ment, using triadic voting (which we also formally analyze to 
show that is better than hot-or-not voting), that 5 out of 6 
groups of users with divergent views (conservatives vs liber- 
als) come to a consensus while aiming to halve the deficit us- 
ing Widescope. We believe that tools like Widescope could 
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have a positive impact on other complex, data-driven social 
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1. INTRODUCTION 

Social Networking sites have transformed our lives dramat- 
ically. Services like Twitter [ll], Google-|- [2] and Face- 
book [11] draw hundreds of millions, who end up spending 
a significant fraction of their time in some social activity 
leveraging the features of the particular service 22 . Popu- 



lar activities include sending a message to a group or tweet, 
chat with others, groupchat, share status and location up- 
dates, and using immersive services like group video chat 
(e.g. Google+ hangouts). Thus social networking tools are 
quite effective for basic social communications and informa- 
tion and thought propagation within one's own social net- 
work. 

Several activities that we perform in our daily lives are more 
involved that the aforementioned ones. For example, we de- 
bate serious topics within our circles like the economy, social 
change, globalization and governmental budgets. For these 
serious conversations, we can use the tools available for all 
social communication like forums. This might be adequate 
or even optimal for a great number of topics, especially those 
which are more qualitative or subjective which do not need 
a lot of data points for argument. However for some topics 
like the US Federal Budget (and the current deficit [s]), we 
believe that existing social networking mechanisms are not 
a good fit due to the dynamic range of the underlying data 
and issues stemming from those, as mentioned below: 



• Data Slicing and Aggregation: A big problem with 
discussions about the budget in the current status quo 
is that debates are centered around isolated topics. 



This is true not only among the average citizens, but 
also among politicians. In one given debate, the focus 
may be on taxes, while in another, the focus might shift 
to healthcare. As a result, it is hard to pin down ex- 
actly what the effects of a candidates proposals are on 
the entire budget deficit. Thus we need a solution that 
encapsulates the entire aggregate of proposals which 
then can be leveraged by users for applications like 
proposing one's own budget and social consensus. 

Different Baselines: A second difficulty is that dif- 
ferent baselines (such as the one from the Congres- 
sional Budget Office 
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the President's Budget [23], 
the House of Representatives' Budget |24], or the Peo- 
ple's Budget [14]) are used by different budget propos- 
als. A budget baseline is an assumption on what the 
future will look like given certain policy continuations 
or lack thereof. When different baselines are used then 
it becomes far too difficult for non-economists to make 
comparisons. When the only information given is how 
much improvement specific positions are making, the 
conversations needs to compare changes in apples to 
changes in apples. Thus we need to separate budget 
positions from baselines by revealing the final dollar 
amounts that a specific position implies. 

The questions we ask in the paper are centered around novel 
approaches to enable serious conversations on the web and 
also to help people achieve shared goals. Here are our simple 
desiderata for such a platform: 



their own proposals or choosing an existing one. Also, users 
can compare and vote for different budgets, and visualize 
their budget overlayed on another proposed budget, in real 
time. 

We then present a very simple model of a proposal where an 
opinion can be mapped onto a single-dimensional point on a 
line and analyze common voting schemes [27] in the model. 
We formally show that a triadic voting scheme is better than 
a naive hot-or-not voting scheme [5] ]9] for picking a winner 
among those who have moderate views, and are likely to 
help users to reach a concensus [28] . 

Then we describe a pilot user trial which leverages this plat- 
form where we design an experiment that enables users with 
divergent opinions to reach a consensus given a shared goal. 
In this case our goal was to halve the deficit of the current 
Federal Budget! We use triadic voting followed by a col- 
laborative step to show that 5 out of 6 groups of the users 
were able to achieve consensus when paired with a user with 
divergent views (users had declared whether they were con- 
servatives or liberals). 

We believe that this paper is a first step and scratches the 
surface of the huge opportunities on the web for serious con- 
versations around complex topics. The potential social im- 
pact using these platforms could be very significant. Con- 
versations could be designed and structured to help users 
reach consensus through mutual understanding and a focus 
on facts and thereby increasing the efficiencies of social de- 
cision making. 



• Users should be able to express their views around a 
complex idea that leverages rich and diverse data. For 
example, in order to express an opinion on the Federal 
Budget, she should be able to quantify proposals and 
present a reasoning for the data. Also users should be 
able to choose a popular proposal from another user 
or entity. 

• Users should be able to compare diff'erent proposals 
using both a high level summarized view and as well 
zoom into individual proposal comments. They should 
be able to vote and view the top proposals among other 
proposals. 

• Users should be able to collaborate with others in real 
time to converge upon a shared consensus proposal. 



In addition, we ask that given a platform as described above, 
we ask what the potential social impact could be. For exam- 
ple, does it really help in online serious conversations? Can 
we use such a platform to achieve some shared goal around 
the conversation topic? What is a good way to compare 
ideas and proposals? 

1.1 Our Contributions 

In this paper, we present a platform called Widescope [12[ 
|15| that enables online social conversations around the US 
budgets driven by rich data visualization. The platform has 
several features that handle dynamic range of the data, allow 
for comparisons and enable collaboration in real time. Using 
our platform, users can propose a budget by either entering 



1.2 Related Work 

Widescope is based on work that is highly interdisciplinary, 
and leverages ideas from online social networking, visualiza- 
tion, user interface design, web based system design, social 
science, psychology and social choice theory. In addition, for 
the specific use case of the US Federal Budget, we compare 
our work with the existing mechanisms available to users. 

While there are several research directions related to the 
different aspects that Widescope touches, we are not aware 
of any platform that does what Widescope does - i.e. enable 
serious conversations around budgets using a data-driven, 
social platform. 

1.2.1 Budgets 

There are three main projects of note that have focused on 
visualization of governmental budget data and motivated 
individual expression and interaction with that data. First 
is the New York Times' Budget Puzzle [20], which had a 
number of mutually exclusive deficit reduction options and 
a novel grid-based visualization. This website, and its popu- 
larity was a source of inspiration for the Widescope project. 

Second is the Next Ten's California Budget Challenge ]21] , 
which allows people to choose from a small number (usually 
2-4) of deficit-reducing options in about twenty key cate- 
gories. We thank the Program Director Sarah Henry for 
sharing how the Budget Challenge started off as a spread- 
sheet, but that focus group experiments lead to greater en- 
gagement using the options format, much like the NY Times 



project. We hope to allow the same detail as the spreadsheet 
while encouraging engagement like the NY Times project. 



sophisticated UI elements for directly comparing and con- 
trasting specific items of data. 



The third is the Washington State Budget [XT'. This site 
had a user interaction similar to the NY Times, although 
with a slightly different graphical output. Mr. Itti provided 
useful feedback during iterations that lead to our current 
website. It is not uncommon for the state budget trans- 
parency requirements to make it to the office of manage- 
ment, and budget employees getting excited about visual- 
ization tools like Widescope, however none seem to employ 
the level of quantitative decision making nor the breadth 
of budget change options that Widescope offers; Widescope 
offers nearly infinitely many ways to adjust the budget. 

1.2.2 Social Choice 

Widescope is related to research in information design, and 
social choice theory. Social choice theory ^6] is a theoret- 
ical framework for studying aggregate choices for collective 
decision making. Although this has been a rich research 
area for decades, most of the findings have been in the area 
of so-called impossibility results which illustrate situations 
in which it is impossible to aggregate individual opinions 
into a collective opinion [?] . Accepting this research, we de- 
cided that the voting mechanism was not the problem in 
the polarization of political debate, it was that people were 
often talking across one another. Studies dating back to 
the 1960aAZs have demonstrated that people process iden- 
tical information differently with different visual presenta- 
tions 18 . Thus we hypothesized that if we could improve 
the conversation, especially through better visualization of 
budget data to make processing the data more natural, then 
the resulting data-driven debate might solve the polarization 
better than a novel voting mechanism. 

In addition to the rich data visualization, Widescope has 
schemes for voting [27] in order to aggregate individual choice. 
We show how novel voting schemes like our triadic scheme 
presented in Section |3] can lead to the probability distri- 
bution of the winning proposal to be concentrated around 
the median proposal, which satisifies the Condorcet Crite- 
rion [281. 



Our work is inspired by such previous studies. In addition, 
we have extended these concepts to include ideas like syn- 
chronous collaborations and a propose/accept interaction 
metaphor, which we believe is a key differentiation. We allow 
users to build their own proposals by picking and choosing 
among others' proposals, as opposed to requiring that users 
generate original opinions. This approach has potential to 
reduce the barrier to entry for new users, and decrease du- 
plicate, noisy commentary. Furthermore, because proposals 
are treated as first-class objects within the system it's pos- 
sible to rank them by metrics like overall popularity, and to 
track their dispersion through the social networks using the 
tool. 

2. WIDESCOPE PLATFORM 

In this section, we describe our platform in detail and demon- 
strate a user interface tailored specifically for enabling se- 
rious conversations about the US federal and state bud- 
gets. The platform was built using a collection of open 
source software libraries; most notably: Ruby on Rails [10| , 
Protovis fs', and JQuery ^6^, which were chosen for their 
widespread adoption and/or unique capabilities. Our data 
backend is a replicated MySQL [t] environment optimized 
for read scalability. All components are hosted on Amazon 
EC2 [l] virtual servers. 

Collaborative budgeting is made difficult by confounding 
factors such as party affiliation, ignorance of important, hard- 
to-find facts, and mis-communication between dissenting par- 
ticipants. Widescope provides structured channels for inter- 
action and debate, and eschews expression of political af- 
filiation or similar biases in a deliberate effort to minimize 
these factors. 

The interface affords: 



1. Specification of proposals for adjusting budget items 
to specific dollar amounts 



1.2.3 Computer Human Interaction 

Our work is related to recent work in the area of Computer 
Human Interaction ( CHI). Widescope shares common de- 
sign elements with Pathfinder [l9], an online platform that 
allows users to collaboratively discuss and analyze data. 
Users can initiate topics that are then augmented by other 
users with data and analysis. Unlike Pathfinder, our tool is 
built specifically for the purpose of discussing budgets, uses 
detailed visualization by default, and has a real-time on- 
line collaboration feature. Voyager and Voyeurs [16] shows 
that the interplay of asynchronous collaboration and visual- 
ization is a powerful infiuencer for user engagement. Work 
on CommentSpace 29 showed how adding lightweight tags 



and link structure to comments can help groups of users col- 
lect and analyze data in a collaborative fashion. We assume 
more about the structure of our data, and take advantage of 
that to a greater extent than a generic platform like Com- 
mentSpace Hows without significant modifications. Because 
our platform targets a more specific use case it allows more 



2. Comparing and commenting on those proposals in a 
structured, quantified way 

3. Mixing-and-matching different proposals into a per- 
sonalized collection that amounts to a holistic proposal 
for an overall budget 



This proposal-centric structure serves to focus and synchro- 
nize users' attention, and provides a framework for relating 
different points of view. For example, some people may not 
have any idea about how to adjust multiple items within a 
specific budget, but they might know a lot about issues re- 
lating to a particular budget item. They are free within the 
tool to express their deep knowledge on a particular subject 
by creating a comprehensive set of proposals without be- 
ing pressured to figure out which other budget adjustments 
they complement. Other users can mix and match such peer- 
generated proposals. Affording various levels of interaction 
such as these allows the majority of people to have a voice 



and build shared understanding without requiring more ex- 
pertise than they might actually have - or having to think 
about the issues at hand in an unnatural way. 

2.1 Data Visualization 
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Figure 1: UI instrumented with walk-through tutorial 
prompts (left), showing adjustment suggestions (right). 
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Figure 3: Precise budget proposal entry form 
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Figure 2: Interactive bar chart visualizing budget alloca- 
tions. 

Widescope's primary feature for expressing budget data is 
an interactive bar chart (Figure [2. 1[ ) that (a) shows the raw 
dollar amounts for budget items - relative to each other and 
grouped as either an expense (negative) or revenue (positive) 
- and (b) affords inline adjustment and experimentation via 
a click-and-drag interaction. 

Because users may not know how to begin modifying a bud- 
get, suggested adjustments are pulled from the pool of ex- 
isting proposals (Figure 2.1 1. If a user simply wants to learn 



more about a particular part of a budget there are category- 
level descriptive popups that are triggered by hovering over 
the labels for budget item bars (e.g. "Health", "National De- 
fense", "Income Tax"). Fine-grain adjustments are possible 



using a form (Figure 2.11 that includes fields for specifying 
the exact amount of an adjustment and text for the rationale 
behind it. 

Proposals used by a budget are displayed in a panel next 
to the interactive bar chart, and comments on individual 
proposals from other users are displayed next to those. The 
same panel contains a drop-down menu listing other bud- 
gets that use each proposal. This provides a clue as to how 



popular a particular proposal is, and a way to navigate to 
potentially similar budgets. There is a number displayed 
prominently above the bar charts that represents the differ- 
ence, positive or negative, of the adjusted budget relative to 
the original budget. This provides an overview metric indi- 
cating how significant all adjustments made so far are to the 
bottom line of the budget in question. 

When thinking about a budget, users may consider differ- 
ent topics at varying levels of specificity. Considerations at a 
very basic level could include: what budget is being adjusted 
(e.g. Federal? California? Nebraska?), and whether or not 
that budget is relevant to a given user. More complex con- 
siderations include: how balanced is a budget overall, what 
is the balance between certain spending and revenue items 
within that budget, and what nuanced reasoning might be 
behind specific monetary allocations (e.g. a 5% increase in 
income tax revenue, sourced specifically from people earn- 
ing more than $250,000 per year). All but this last, most 
fine-grained level of specificity are addressed directly by the 
bar chart visualization and its supporting interface elements. 
The latter, more nuanced kind of consideration, is relegated 
to free-form text, either as the content of a proposal's ex- 
planation or comments made on a proposal, or both. 



How would you rate this proposal? 
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Figure 4: Comment entry form with sliders for agreement 
and importance. 

The commenting system invites users to quantify otherwise 
free-form feedback by indicating amount of agreement or dis- 
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Figure 5: Comment agreement and importance matrix. 

agreement with a given proposal, as well as perceived impor- 
tance or the lack thereof (Figure 2.1 1. This feature is meant 



to encourage structured commentary on relevant issues, and 
to provide concrete numerical data points for further anal- 
ysis. This feedback is represented on a 2 dimensional scat- 
ter plot with axes for agreement /disagreement (horizontal 
axis), and importance/unimportance (vertical axis) (Fig- 
ure |27l]). Precise ratings are aggregated within discrete grid 
cells, which vary in tone from light grey to black depend- 
ing on the amount of overlap among aggregated ratings. A 
cell representing more ratings with appear darker than one 
representing fewer. This provides a visually cohesive rep- 
resentation of the discussion about a particular proposal, 
and can be used as a high-level summary of sentiment in 
case commentary grows too large to be read and thoroughly 
understood. 

2.2 Voting and Collaboration 
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prominence over entering new, from-scratch proposals); and 
comparison voting. The latter works by showing a user two 
budgets for the same state side-by side, and inviting users 
to select which one is better (Figure |2.2[ | . This serves as 
a low-friction voting interface, as users don't have to abso- 
lutely agree with a budget to vote for it; they just have to 
agree with it more than the other budget. It provides an 
easy mode of interaction so that even users without much 
to contribute to the budget-making process can contribute 
by curating others' budgets. 
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Figure 7: The collaboration page. Two users can collaborate 
in real time. The user's budget is displayed on the left side 
and the other users budget is overlayed either on top of her 
budget or on the baseline budget. 

Because rapid feedback and personal dialog are key factors 
for effective debate, Widescope has a specialized interface for 
real-time collaboration. The collaboration interface enables 
users who are simultaneously logged in to send continuously 
updating budget changes to each other via the interface de- 
picted by Figure [7| A user's own budget is displayed with 
the left-most column of charts, and the other user's budget, 
represented by the right-most column of charts, can be over- 
laid either on top of her budget or on the baseline budget. 
As a user moves her chart's bars and selects various pro- 
posals, the behavior of the interface is exactly as if she was 
editing her own budget, but the chart on the right represent- 
ing the other user's budget updates simultaneously with her 
changes (if viewing the other's overlaid on hers), and with 
any changes made by the other user. The amount of Dis- 
agreement between each user's budgets is represented Eis a 
simple horizontal percentage meter above the charts to the 
left, where Disagreement is defined as: 

Given users A and B, Given category C G Revenue and 
Expense categories Ac — Dollars allocated to C by User A 
Be — Dollars allocated to C by User B Ac — Ac — Be 



Figure 6: Budget comparison and voting page. 
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A significant challenge facing official budget administrators 
is that they are faced with their task having little or no 
relevant prior experience, especially when freshly elected. 
Anyone using Widescope for the first time faces a similar 
challenge: "Where do I start and what am I even supposed 
to do?" The tool has specific features to address this chal- 



lenge: a guided walkthrough (Figure 2.1 1, which is the de- 



fault mode for new users; proposal suggestions (always given 



Any amount of Disagreement beyond 10% is considered quite 
significant and displayed simply as >10%. 

Though these mechanisms for collaboration are primitive, 
they allows two users to visualize each others' budgets in real 
time, relative to their own budgets, with a choice of overlays. 
This enables a different kind of comparative budgeting than 
previously described for times when users may care not only 



about which of two budgets is better, but also about how 
changes to specific categories of one budget relate to those 
of another, and about having an active conversation about 
otherwise static data. 

3. TRIADIC VOTING SCHEMES 

The purpose of voting is to take voter opinions over a can- 
didate set and produce a good candidate, as measured by 
various properties. Given the comparison functionality in 
Widescope, it is natural to ask if there are voting schemes 
that can take opinions, expressed as comparisons between 
budgets, and aggregate them together in a way to choose 
a good budget. In this section, we propose a comparison- 
based voting scheme, Triadic Voting, and compare it to a 
commonly used comparison-based voting scheme, Hot-or- 
Not. We demonstrate that Triadic Voting is more efficient at 
eliminating outliers and converging to good solutions com- 
pared to the typical Hot-or-Not solution. 

Triadic Voting is an iterative voting scheme that distin- 
guishes between moderate and strongly polarized proposals. 
We compare this to a iterative version of the Hot-or-Not 
scheme. In the standard Hot-or-Not scheme, two proposals 
are randomly presented to a user who selects the one that 
she likes the moslQ Based on several of these votes, we elim- 
inate the losing proposals and repeat. The general idea of an 
iterative voting scheme is that highly polarized proposals are 
also generally liked by a smaller portion of the population. 
When pitted against another moderate proposal, a highly 
polarized proposal will lose more often than it wins and 
hopefully, highly polarized proposals can be quickly elim- 
inated. 

This can easily seen and formalized if the proposal space is 
single-peaked, i.e., the proposals can be approximated by a 
one-dimensional number. Assume that voter opinions are 
points on a line and that each voter gives a proposal corre- 
sponding to the point it lies on. Any voter will like propos- 
als that are closer to it as per the distance between the two 
proposals. In this case, the median proposal (which is also 
intuitively the most moderate proposal) satisfies the Con- 
dorcet property, which means that it would win any pairwise 
election against another proposal. This is because at least 
half of the voters will vote for the given proposal. If the 
opposing proposal is on the right side of it, then the median 
proposal will win all the voters on the left and vice versa. 

In the Triadic voting scheme we propose, three voters x, y, z 
are randomly selected, each of which has his or her own pro- 
posal. Then, each voter is made to vote between the other 
two proposals. That is, x votes between y and z, y votes 
between x and z, and z votes between x and y. This is simi- 
lar to Hot-or-Not in that users are making pairwise compar- 
isons. The difference, however, is that the comparisons being 
made are correlated in a very precise way depending on the 
group of three candidates that are chosen. Intuitively, we 
can see a nice property in this voting scheme. If one highly 
polarized proposal exists, it is unlikely to convince two other 
voters to vote for it and be the winner in this group of three. 
The 'median' proposal out of the three is going to win, so 

'^Note that Hot-or-Not sometimes refers to an absolute rat- 
ing of single proposals on some scale. We are referring to 
the comparison-based variants |9j 



a highly polarized proposal doesn't stand a chance. Below, 
we show a simple proof demonstrating this comparison. 

Theorem 1. Let a continuous distribution of voters be 
uniformly distributed between zero and one. Let gHot-or-Not{x) 
and gTriadic{x) bc the probability density of x being the next 
winning candidate m the Hot-or-Not and Triadic voting pro- 
tocols respectively. Then, 

QTriadic = Gxil — x) 

QHoUor-Not — 3a;(l — a;) + 2 

In particular, 

9Hot^or^Not^\gTr.a,Hc+\f{x) 

where f{x) = 1 is the uniform distribution. 

Proof. In a round of Triadic voting in a one-dimensional 
proposal space, the median point will always win. This is 
clear because the right-most point and the left-most point 
will vote for the median point. Regardless of who the median 
point votes for, he still wins with two votes. Then, 

gTHadic = 3!/(a;)F(a;)(l-F(x)) 

where F(x) is the cumulative distribution function of fix). 
This is because 3! is the number of ways to choose three 
points, f{x) is the probability of choosing point x, F{x) is 
the probability of choosing a point left of x, and 1 — F(x) is 
the probability of choosing a point right of x. So the above is 
the probability of x being chosen as the median point, which 
is its probability of winning. For a uniform distribution of 
voters, f{x) — 1 and F{x) = x, so 

ffTriadic = 6x(l — x) 

In a round of Hot-or-Not voting in a one-dimensional pro- 
posal space, the point x will win against y only if the voter 
z is closer to x than y. Then, 

PHot-o.-Not = 2f{x) £ f{y) (l - F (^)) dx 

+ 2f{x) jj{y)F[^)Ax 

where we have a factor of 2 instead of 6 because it mat- 
ters which point is the voter, so there are only two ways of 
choosing. For a uniform distribution of voters, we have 



ffHot-or-Not — 




= 3x(l-x) + ^ 

□ 



(a) fix) = 1 



(b) JfTriadic 



(c) (?Hot-or-Not 



Figure 8: (a) The original distribution of proposals, (b) The distribution of the proposal after one round of the Triadic voting 
scheme, (c) The distribution of the proposal after one round of the Hot-or-Not voting scheme 



In the above theorem, we show the probability that any 
given candidate budget is not eliminated after one round 
of voting. The distributions are plotted in Figure [S] It is 
quite clear that the Triadic voting scheme is significantly 
better than the Hot-or-Not scheme at eliminating proposals 
that are close to the boundary and centering the probability 
around the median candidate. 

4. USER TRIALS - REACHING CONSEN- 
SUS 

As mentioned in Section [ij it is hard to find web platforms 
that facilitate discussions, especially when the issues are 
complex and contentious. For example, in the case of bud- 
gets, it is difficult to express views in standard fora due to 
the rich financial data coupled with the numerous propos- 
als made by other people. It is especially hard to construct 
one's opinion or budget from the data while agreeing or dis- 
agreeing with others' proposals for different categories. 

In this section, we ask the social implications of a web plat- 
form that facilitates discussions on complex issues. For ex- 
ample, we would like to know if users actually changed their 
mind after collaborating with others on budgets using the 
Widescope platform. In particular, we will also demonstrate 
the use of the triadic voting scheme, the properties of which 
were analyzed in the previous section. 

4.1 Experiment 

In order to answer the above question, we conducted a pilot 
user trial with twelve subjects as follows. First, we set a goal 
that can be quantified, i.e. we wanted users to reduce the 
federal budget deficit by half. Second, we gave our subjects 
a limited time to make decisions (two hours). This leads to 
a much more controlled experiment. We divided the total 
time into rounds. The major steps for the study were: 

1. Setup: The users were classified as either conservative 
or liberal based on a survey with simple yes/no an- 
swers. We chose twelve candidates of which half were 
conservatives and the other half liberal. 

2. Round 1 (30 minutes): Users are given a list of internet 
resources (e.g. for learning about the US Budget and 



an explanation of how to use the platform Widescope 
for creating a budget. Users then put together their 
own proposal on how to solve the US budget (along 
with their own justifications). 

3. Round 2 (20 minutes): Four groups of three people 
are formed randomly. In these groups, two belong to 
the conservative camp and one to the liberal camp or 
vice versa. In each group, each member gets five min- 
utes to explain their position to the others within the 
same group. Then, each member votes for one of the 
other two proposals. We expected that the two users 
from the same camp would vote for each other and 
the user from the minority camp would vote for the 
more moderate proposal from the majority camp. In 
this way, we would have identified a strongly leaning 
conservative/liberal (SC/SL) and a moderately lean- 
ing conservative/liberal (MC/ML). This is our triadic 
voting. 

4. Round 3 (30 minutes): We then pair up SC and SL 
users, MC and ML users, and the minority conserva- 
tive and liberal users. There are two of each of these 
pairs, with the minority conservative/liberal groups 
acting as controls. Now, we ask each of these pairs 
to collaborate and present one consensus budget (a 
budget that both agree on) that cuts the deficit by at 
least 50% or as much as they are able to. 

5. Surveys: We presented them with survey questions at 
the end of each round about the following: 1) strength 
of opinions, 2) opinions on individual income tajces, 3) 
opinion on entitlement funding, 4) opinion on corpo- 
rate income taxes, 5) opinion on national defense. At 
the end of Round 3, we also ask them how successfully 
they felt like they were able to come to consensus. 

4.2 Results 

Our first observation was that in round 2, users did not 
vote according to our expectations. Often, a user from the 
majority camp voted for the proposal given by the minority 
member i.e. in a group with two liberals and a conservative, 
the liberal actually chose the conservative's budget! In fact 5 
out of the 8 majority members voted for the opposing camp. 



Wc observed that many did not know a lot about the US 
budget, based on the basic nature of the questions we were 
asked during the trial We conjecture that many citizens do 
not know a lot of the details of the US budget and their opin- 
ions might be derived from opinions of friends. However, we 
believe, that once they are given access to educated informa- 
tion, they will make decisions based on the information and 
surprisingly, they do not just stick to their original position 
as is often unfortunately observed in Internet forums (and 
on capitol hill!) 

We observed that users were highly successful at coming to 
consensus in the third round. 5 out of 6 groups came to 
consensus solutions within the time frame. The last group 
felt that they could have come to consensus if they had a 
little more time. 10 people rated 5 for how strongly they 
were able to come to consensus, 2 people rated 4. 10 people 
said that given more time, they would come to a 50% con- 
sensus, 2 people said the other person was reasonable but 
had fundamentally different views. This was a big surprise 
to us, and is the key empirical finding of this paper. 

We noticed that several users had stronger opinions by the 
end of the user trial. Average strength of opinions (1-5) 
changed from 2.75 to 3.5 to 3.67 from pro-trial, post voting 
(Round 2), and post consensus (Round 3) stages respec- 
tively. Looking at it in more detail, 7 users had a stronger 
opinion by the end of the user trial, 4 users had the same 
strength of opinion, 1 user had a weaker opinion (i.e. her 
score went to 2 from a 3). We believe that after people 
have become more educated, and have obtained more infor- 
mation, they have a stronger opinion since they feel it is 
backed up with evidence. 

Another very interesting observation is that people actually 
flipped sides for several proposals during the trial! Looking 

at each of the opinions (from the surveys), we had that: 1) 
Individual taxes: 7 had the same score before and after, 3 
mid ranked users (with a score of 3) moved to moderate 
positions on both sides (a score of either 2 or 4), 1 user 
become more strongly opinionated (increased score from 4 
to 5), 1 user went from moderate to neutral (score 3 changed 
to 2). 2) Entitlement funding: 3 had the same score before 
and after, 4 became stronger in their original position (i.e. 
either increased or decreased their scores further), 2 moved 
from moderate positions to neutral, 1 moved from neutral 
to moderate, and 2 flipped sides completely! (e.g. score 
changed from 5 to 2, or score changed from 2 to 4). 3) 
National Defense: 4 had the same position before and after, 

3 become stronger in their opinion (score decreased ffrom 
2 to 1), 3 flipped sides (score of 4 became 5 and score of 
2 became 1), 1 became neutral (score 4 decreased to 3), 1 
became more moderate (score changed from 5 to 4). In the 
case of national defense, all the movement was one sided 
towards the direction of decreasing military spending. This 
is surprising given that we had an even mix of liberals and 
conservatives. 4) Corporate taxes: 6 had the same position 
before and after, 1 moved to neutral (score decreased from 

4 to 3), 1 moved to more strong (score changed from 4 to 
5), 2 moved away from neutral to strong (score 3 increased 
to 5), 1 moved to weaker (score 5 decreased to 4), 1 flipped 
sides (score 4 became 2). It is especially amazing to see that 
people flipped sides in some topics (in both directions) . It is 



also interesting that for certain areas like national defense, 
every person moved in one direction (this is also because 
both conservative and liberal parties believe that military 
costs should be cut, just in differing amounts). 

Thus, our observations confirm our hypothesis that tools 
like widoscopc might be able to help users to formulate their 
opinions and have a conversation about a complex subject. 
Also it w£is very interesting to note that our tool helped 
users to change their opinions upon analyzing the rich finan- 
cial data, instead of forming opinions based on qualitative 
beliefs. Also, contrary to our expectation, we found that 
almost all groups of conservative-liberal pairs were able to 
come to consensus through using our website as a collabora- 
tion tool. This is a result that gives hope to a problem that 
didnaAZt seem solvable and points to many future questions 
in collaborative website design. 

4.2.1 Discussions 

During our user trial, we found the users to be generally 
reasonable. Here are a couple of further observations: 

1. Widescope gives people good common data they can 

research and have discussion based on a common un- 
derstanding. Typical websites for conflict-resolution 
do not have this data, so users can only resort to on- 
line shouting matches to get their voices heard. 

2. Widescope captures the entire opinion through one 
concept. Typical websites like online fora are unstruc- 
tured. As a result, people cannot observe the effects 
of their opinions. Often they go back and forth on dif- 
ferent issues i.e. a user may have many good reasons 
for cutting taxes, but when they do so, they will have 
to see that cutting taxes by x% will make it so much 
harder to decrease the deficit. However with widescope 
they can see the effect visually and they're forced to 
consider the budget as a whole. 

3. Widescope helps users be more rational. When a user 
proposes a change in a budget subcategory, the system 
displays a variety of proposals to choose from, thus giv- 
ing the user a chance to rationalize. Thus our platform 
using subtle cues to help be more rational and consider 
other's proposals. 

4. Widescope allows us to have a goal based consensus via 
collaboration. On most websites, the goal is more to 
exert one's opinion. Here, if the other person disagrees, 
then it will be evident during a collaboration (via the 

disagreement meter). As a side note, this also points 
to aiding the solution of real problems with average 
citizens. Though the budget committee and congress 
members are more informed and spend their complete 
attention on these issues, they might have their own 
biases. Average citizens, though less informed, as an 
aggregate, may have fewer biases and self interests. 
Thus widescope can be viewed as a platform for crowd- 
sourcing of ideas on complex issues. 

Media is often seen to polarize people. Peojjlc often pick out 
the information that supports their viewpoint, etc. However, 
in our user trial, we saw a positive effect of leveraging the 



web. We found that people become more strongly opinion- 
ated when they receive more information, but they do not 
necessarily need to be polarized by it. When placed in the 
context of collaborative discussion, rather than being talked 
at by the media, results can go both ways. 

5. FUTURE DIRECTIONS 

As we mentioned before (Section [T|, we have touched the 
tip of the iceberg in designing systems that enable serious 
conversations on complex data driven topics via consensus 
and collaboration. It is a new area and is currently being 
investigated in the following directions: 

UI improvements: We are continuing to improve the UI. 
The collaboration tool is being enhanced to include the sta- 
tus of users and suggestions of users one might want collb- 
orate with. We are also prioritizing and ranking the list 
of the proposals that are displayed when users change their 
own proposals. We are also introducing micro proposals. 

Large scale user trials and experiments: Given the sur- 
prises in the small user trial described above, we are inspired 
to try bigger trials with the tools we have developed. While 
we can collaborate in real time using our tool, we need to 
build another tool to manage the collaboration space. Also 
we need to highlight and rank successful collaborations. We 
are considering building an online campaign that uses the 
components of Widescope to help users converge on budget 



Theoretical understanding: An interesting question is to 
design more efficient voting schemes for faster convergence 
towards consensus proposals. For example how many triadic 
groups do we need to sample from a population for us to 
reach approximate consensus. Also, there might be other 
better voting mechanisms apart from our triadic voting. 

Link with Social Choice and Behavioral Economics: 

We believe that further research and user trials will lead to 
deeper links between novel visualization, social choice the- 
ory, and behavioral economics 13 . For example, what kind 



of newer agent models might arise by leveraging Widescope 
for collborative debates on complex subjects and how that 
might impact the aggregate choices. 

6. CONCLUSIONS 

In this paper we presented a web platform called Widescope 
and showed it can be useful for enabling conversations around 
complex (and data driven) topics such as budgets using rich 
data visualization, ability to define one's own budget while 
choosing between others' proposals or creating one's own, 
ability to compare between budgets and collaborate in real 
time with other users. In addition, we showed that this 
platform has the potential to make social impact by help- 
ing users converge their thoughts through the lens of a user 
trial. 

We modeled the triadic voting scheme for proposals (where a 
proposal mapped onto a single-dimension point) and showed 
that it is better than the comparitive hot-or-not voting since 
it centers the probability of winners around those who have 
moderate proposals, thus satisfying the Condorcet property. 



This simple formal result is also demonstrated in our user 
trial. 
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